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Method and system for tag detection and tracking in MRI tagged images 



FIELD OF THE INVENTION 

The invention relates to an image processing method of detecting "tag" points 
in a "tagged" image of a sequence of images, said "tags" being the pattern observed on the 
"tagged" image resulting from the spatial modulation of the magnetization in the observed 
5 zone. The invention relates to any kind of modulation patterns that can be parameterized in 
the frequency domain. Tags can be, for example, straight lines in one modulation direction 
(SPAMM protocol), straight lines in several directions generating all kinds of grids (SPAMM 
protocol) or generating radial patterns and circles of different diameters. In the following a 
tag would designate any kind of constituent part of a larger pattern that can be defined in the 
10 frequency domain. Generally it would be a straight or a curved line at the beginning of a 
sequence, which line is then deformed by the movement of the zone wherein the 
magnetization is modulated. Following the tag and its deformation is an issue of the 
invention. 

The invention also relates to a computer program product wherein the method 
1 5 is implemented, to an image processing system and to an MRI apparatus to carry out the 
method. 

The invention finds its application in Magnetic Resonance Imaging (MRI). 



BACKGROUND OF THE INVENTION 

20 A semi-automatic image processing method for detecting tag points is already 

known from a publication by M. Guttman et al. entitled "Tags and Contour Detection in 
Tagged MR Images of the Left Ventricle" published in IEEE Trans. Med. Imaging, 
13:74-88, 1994. This article specifically relates to tag lines. As described in this publication, 
the user initializes tag line points and these points are followed by an algorithm based on a 

25 dynamic programming, which is guided by the user from one image to the next by using an 
intensity profile. The attribution of a point to a tag line is always checked by the user, 
because a point could easily be affected to two neighboring tag lines. This method does not 
use any modeling of tag lines nor any predicted movements of tag lines. According to this 
known method, the image processing is slow and is consequently difficult to implement in 



:i -e o e e: 3 «i s o :s o o jl 

PHFR000116 



2 24.08.2001 
view of diagnosis clinical applications. Moreover, since the algorithm is not fully 
autonomous for tracking the tag lines, this known method requires many user interactions for 
yielding a valid tracking of a tag line from one image to the next. Besides, the accuracy of the 
detection of tag points is not validated by any analysis or reconstruction of movement. 

5 

SUMMARY OF THE INVENTION 

It is an object of the present invention to provide an image processing method 
of accurately fully automatically detecting tag points in an MRI image that is tagged 
according to a modulation pattern as described in the introduction. 

10 It is to be noted that in an image of a sequence of images, each tag shows a 

motion from a current image to the next one. A current image is defined as the image of the 
sequence at time (t) wherein tag points are under detection, time t being incremented from the 
start to the end of the sequence. According to the invention, said motions of tags are taken 
into account. The motions of tags are predicted by spatial and temporal continuity to yield a 

1 5 predicted image, which predicted image is further used to detect tag points in a next image. 

It is an object of the invention to yield such a predicted image with sufficient 
information to allow an accurate detection of tag points. 

In accordance with the invention, an image processing method of detecting tag 
points in a current tagged image of a sequence of tagged images, comprises steps of : 

20 in the current image, estimating points which have optimal intensity values in 

intensity profiles and labeling said points as candidate points of a tag ; using a previously 
constructed predicted image constituted by predicted tags determined from tag equations of a 
preceding image of the sequence and from spatial and temporal parameters ; and, in the 
current image, detecting tag points among said candidate points from said previously 

25 constructed predicted image ; determining tag equations for the current image from said 

detected tag points ; using said tag equations in the construction of a further predicted image 
for processing a next image of the sequence. 

The determination of an equation for each tag of each image of the sequence, 
that is a modeling of tags, allows to work with whole tags, for example, whole lines, instead 

30 of points to estimate motions from one image to another. As, according to the invention, 
whole tags instead of only points on a more or less interrupted straight or curved line are 
available, and as an equation of each tag is known, it is possible to construct, by spatial and 
temporal continuity, a predicted image constituted by predicted tags, for a next image, which 
predicted image is rich in information since whole tag positions are predicted. Moreover, 
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knowing the likely positions of each tag as a whole allows to determine that a candidate point 
belongs to a specific identified tag : consequently an automatic tracking of tags is performed 
from one image to another, from the beginning of the sequence where the identification of 
specific tags is easy to the end where motions of tags render the identification harder. 
Another advantage of the algorithms working on whole tags, according to the invention, is 
their rapidity. 



equations of tags by using a Rational Fitting from the detected points. Said Rational Fitting 
can be used alone or in combination with a further fitting using a Residue Technique. The 
obtained detection is very accurate as this particular mathematical expression of tags allows a 
very good fitting to real tags, especially when tags are straight lines at the beginning of the 
sequence, and, consequently, allows to construct trustful predicted tags for following images. 



belonging of a candidate point to a specific identified tag even when a low temporal 
resolution is used. In effect, the longer the time between two images of the sequence, the 
larger the motion of tags is from one image to the next. Consequently, even when modeling 
of tags according to the invention is used, there is a chance of selecting a point as belonging 
to a given tag although, in reality, this point belongs to another appropriate tag. 



an MR image presents minimum magnetization which is conventionally considered to 
constitute the tags, and maximum magnetization, less detectable than said minimum 
magnetization, which is generally very sharp, and constitutes another family of tags, labeled 
positive tags. Two tags conventionally corresponding to a minimum of magnetization are 
always separated by a positive tag. Optimum points estimated by the image processing 
method of the invention include the points corresponding both to maximum and minimum 
values. The points corresponding to maximum values are especially well localized when 
working on CSPAMM protocol images, as these images present a good contrast. The method 
of the invention comprises steps to use the alternating pattern of these two kinds of tags and 
their spatial characteristics in order to detect tag points and in order to determine with great 
accuracy to which specific tag a point belongs. 

In an embodiment of the invention, the detection step using characteristics of 
the predicted image comprises sub-steps of : 



In an embodiment, the method of the invention comprises steps of computing 



In an embodiment, the method of the invention comprises steps to evaluate the 



In an embodiment, the invention takes into account that the intensity profile of 
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distinguishing two kinds of tags : negative tags corresponding to minimum 
magnetization and to maximum intensity in the intensity profile, and positive tags 
corresponding to maximum magnetization and to minimum intensity in the intensity profile ; 

distinguishing two kinds of candidate points : candidate points being optimal 
5 value points corresponding to maximum intensity in the intensity profile, and candidate 
points being optimal value points corresponding to minimum intensity ; 

selecting points of a negative tag D as being the candidate points 
corresponding to the maximum intensity, which are situated between the two predicted 
positive tags that surround the predicted negative tag that corresponds to the negative tag D, 
10 and 

symmetrically selecting the points of a positive tag. 

The delimitation of the region where tag points can be detected requires the 
use of whole predicted tags, which is the main feature of the invention. This delimitation 
affords the advantage of critically reducing the chance of selecting a point that belongs to a 

1 5 given tag of one kind to another tag of the same kind, which was common when only 

negative tags were conventionally used. Moreover, the use of maximum value tags offers the 
advantage of providing more points than conventional techniques using only tags 
corresponding to a minimum value of magnetization. Characteristics of the predicted image 
are consequently more abundant, allowing a more accurate detection of tag points and a 

20 better tracking of the tags, especially in case of low temporal resolution. 

In an embodiment, the method comprises a step of automatically constructing 
a predicted image including sub-steps of choosing a given number of privileged points on 
tags of the preceding image of the sequence ; calculating from positions of said privileged 
points in the preceding image of the sequence, a predicted position of said privileged points ; 

25 constructing predicted tags of the predicted image from predicted positions of said privileged 
points. This last step can comprise sub-steps of estimating a minimizing function (f) that 
minimizes the distance between the predicted positions of privileged points and the result of 
the application of this minimizing function (f) to these privileged points ; applying the 
minimizing function (f) to tag equations of the preceding image of the sequence to construct 

30 the tags of the predicted image. Said minimizing function (f) can be a function of similarity 
expressed as f(z)=lz+c, where 1 and c are complex parameters. 

In an advantageous embodiment of the invention, privileged points are 
intersections between tag lines obtained from an MR image tagged on two different 
directions or between tag lines obtained from two MR images each tagged in one direction 
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different from the tagging direction of the other, said two MR images corresponding to a 
similar step of the sequence. The intersections are calculated from the two tag line equations. 
The use of this feature presents a particular advantage since these intersections are easily 
identifiable on every image of the sequence and, consequently, can be easily tracked from 
5 one image to another. 

By acting on whole tags instead of acting on points, the method of the 
invention allows fast image processing, since an algorithm acting on whole tags knowing an 
equation for each of them takes up few resources. Taking up resources can be further reduced 
by using an image segmentation, for separating regions of interest from other regions where 
10 tag lines exist, but do not provide interesting information. 

The invention first allows a very reliable detection of tag points and 
consequently allows a good tracking of tags from one image of a sequence to a next image of 
the sequence. 

1 5 BRIEF DESCRIPTION OF THE DRAWINGS 

The invention is described hereafter in detail, with reference to the schematic 
drawings wherein : 

Fig. 1 is a flow chart for illustrating a method of detecting tags ; 
Fig. 2 is an intensity profile of an MR image in the modulation direction in the 
20 case of a unidirectional modulation of magnetization ; 

Fig. 3 is an example of a spatial condition used for selecting tag points ; and 
Fig. 4a and Fig. 4b are two examples of MRI apparatus for carrying out the 
method of the invention. 

25 DETAILED DESCRIPTION OF THE EMBODIMENTS 

FIG. 1 is a flow chart which illustrates an image processing method according 
to the invention. In this diagram, processing steps are illustrated by oval blocks and the 
results of the processing steps are illustrated by rectangular blocks. 

Referring to FIG. 1 , the image processing method has iterative steps applied to 

30 a sequence of tagged images for tracking tags on successive images of a sequence of MRI 
tagged images. According to this method, tag points are detected by using a predicted image 
constructed from, at least, the preceding image. Then, the detected tag points are assigned to 
a specific tag, said specific tag being consequently "tracked" from one image to the next 
image. 
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An initialization step 1 1 is required as, for the first image of the sequence, at a 
first instant called time to, there is not any preceding image available to construct a predicted 
image. The first image of a sequence of tagged images is a non-deformed image presenting, 
for example, straight and parallel tags. These straight and parallel tags correspond to the case 
5 of unidirectional line modulation or grid pattern modulation, which are preferred features for 
the invention. Consequently, the initialization step 1 1 constructs a first set of equations of 
tags T(to-l) (12) at a previous instant called time (to -1) describing, for example, straight and 
parallel lines. This first set of equations is then used for constructing a predicted image used 
for the detection of tag points of an image at time to. The method according to the invention 

10 is then effectively implemented on a current image 10 at a current instant called time t of the 
sequence from t 0 to tend of sequence, which current image is denoted by image I(t). An estimation 
step 13 applied to said current image I(t) 10 estimates optimal points denoted CP(t) 14 and 
labeled Candidate Points. 

Then, a detection step 15 performs a detection of tag points denoted TP(t) 16. 

1 5 This detection step 15 detects the tag points TP(t) 16 of the tags among the candidate points 
CP(t), using characteristics of a predicted image PI(t) 17 automatically determined by a 
construction step 18 of the predicted image PI(t) 

In the construction step 18, the predicted image PI (t) is formed by predicted 
tags, which are computed from tags equations 19 of at least a previous image of the sequence 

20 with respect to the time t of the current image and from spatial and temporal parameters, said 
tag equations being denoted T(t-l). This construction step 18 uses temporal parameters by 
using at least tags T(t-l) provided at an instant (t-1) 19, but can also use tags T(t-2) of an 
instant (t-2) and tags T(t-3) of an instant (t-3) 22 and so on as soon as these data are available 
from the processing of images of the sequence. 

25 According to an advantageous embodiment of the invention, a spatial 

condition using the intensity gradient of the predicted image PI(t) 17 as a spatial parameter 
allows to discard the greater part of contour points and noise. At each point of the predicted 
image PI(t) 17, an orientation angle, denoted p(x,y), is given to the predicted tags by the 
normal vector. Simple interpolation techniques, such as bilinear interpolation, enable to 

30 compute this angle p(x,y) for every point in the predicted image. A maximum error 

coefficient a (the same for every point) is attributed for p(x,y) in the whole image, said 
coefficient a depending of the noise level of the real-world images. Candidate points which 
are selected using this spatial condition are the ones where the gradient direction lies in 
P(x,y) +/- a. This spatial condition application is used to discard the greater part of contour 
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points and noise. Another spatial condition using the distance of a candidate point from 
predicted tags as a spatial parameter can be used, said distance being included in a given 
range or being a function of positions of the predicted tags. 

In an example, spatial conditions on distance use the fact that, referring to 
5 FIG. 2, the intensity J(x) profile in the modulation direction of an MR image tagged in one 
modulation direction x presents minimum value points m of magnetization, which are 
conventionally considered to constitute the tags, here denoted negative tags, and maximum 
value points M, less stable than minimum value points m, which are generally very sharp. 
These maximum value points M constitute another family of tags, labeled positive tags. 

1 0 Minimum value and maximum value points are characterized and, further localized, by 
cancellation of the derivative function. Using conventional image processing, maximum 
value points M can be distinguished from minimum value points m. Although maximum 
value lines are less detectable than minimum value lines, the use of maximum value points 
allows to work on a narrower grid of tags than when only minimum value points are used as 

15 is conventionally done. 

In an embodiment of the invention, an advantageous spatial condition on the 
distance of a candidate point from predicted tags of the predicted image can be used for using 
the predicted positive and negative tags and their alternating patterns, since two tags are 
always separated by a positive tag, and vice versa. For example, as illustrated in FIG.3, the 

20 candidate points corresponding to minimum intensity values and represented by a x and lying 

between predicted tags D* and D* +1 , and near enough to predicted tag D n are assigned to 
tag D n . Predicted entities are represented with a A . This enables to assign the detected tag 
points to specific tags without ambiguity, whatever the tag pattern used. This feature is 
especially interesting when the sequence is acquired with a low temporal resolution. 
25 Tag points 16, obtained after the tag point detection step 15, are used in a 

determination step 20 to determine the tags T(t) 21 of I(t) (FIG. 1). 

A technique of determination of the tag equations is proposed hereafter : In a 
preferred embodiment, a Numerical Rational Approximation Algorithm is applied to 
30 calculate an equation of tags from selected tag points. This approximation is a first "rigid" 

representation of tags in the space of rational functions of a degree lower than 4 and denoted 
FR4 4. These functions are able to interpolate smoothly in informationless zones (typically 
inside the myocardium), far better than polynom-based interpolators. Given a set of p points 
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IW'^j")' i=l—/?} labeled to a same tag, the best rational least squares approximation on 
function y—f(x) can be computed to find : 

( r. . A v« _ ..k 

In ffeFR n>n 
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Consequently, the following iterative problem is introduced 
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e discrete approximation of the two integrals by Riemann sums leads to a linear system in 
{dj.bj}. The convergence is rapidly observed in practice. 

In an advantageous embodiment, a second level of approximation is added, to 
locally compensate for the error. Named "elastic" representation, this approximation uses Ig , 

1 0 that is a partition { [x, , x i+ \ ],i=l...n} of step 8 along the x-axis. On [jc,- , jc /+1 ] , the residue R ( 
is expressed by the median of the error between a sample and the rational function. Then, the 



error is : 

f 



E(x)= 

V i 



* e 



That is to say, the convolution of the step-function ). by the centered gaussian of standard 
1 5 deviation a. E(x) simplifies in : 



n-l i 

E(x)= R x er f(x /a)- R n er f((x - x n )/ a) + £ - R t )er f((x -x,)/ a) 



»=1 



Hence, the description space for tag equations is formally : 



FRe <r.Ix = FR 4A + Vect \ er f\ 



( x-x k 



Equations found by this approximation allows to very closely approach real tags. A reliable 
20 construction of the predicted image can then be realized. 



25 



A predicted image construction is further proposed hereafter : Tags T(t-l) are 
used in a predicted image construction step 18 (FIG. 1), which uses the tag equations from at 
least the preceding image, for the construction of a predicted image then used to process I(t) 
from a given sequence. 
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In an embodiment of the invention, privileged points are chosen among points 
on the tags of at least a preceding image. A predicted position of each of said privileged 
points for the time of the next-in-time image of the sequence is evaluated from positions of 
said privileged points on, at least, the preceding image. 
5 In an advantageous embodiment, tags are lines and equations of tags are 

known in two different directions, from an MRJ image tagged in two different directions or 
from two MRI images, corresponding to similar times of the sequence. Each of the two MRI 
images is tagged in one direction different from the tagging direction of the other, and 
privileged point positions are calculated as being intersections between tag lines in the two 
10 different directions. It is important to note that intersections are advantageously used, because 
they are easily identifiable on every image of the sequence and, consequently, can be easily 
tracked from one image to another. It is further important to note that when intersections are 
used while maximum and minimum magnetization tag lines are worked with, a very dense 
mesh of tag lines and a dense set of intersections is obtained, enabling a very accurate 
1 5 determination of movements of tag lines. 

In an example, for calculating a predicted position for privileged points, the 
acceleration of privileged points is considered to be constant. The discrete scheme is then, for 
example, a third order linear filter : 

A?j = 1 - 3A?j 2 + A?j 3 . 

20 Predicted entities are represented with a A and, in this example, tag points from three 

preceding images are used as soon as these three images are available. From the set of points 
obtained, predicted tags can be constructed by employing an approximation among a spline 
function approximation or a rational approximation or any kind of interpolation. 

In a preferred embodiment, the motion is constrained by estimating a function 

25 (f) that minimizes the distance between the predicted positions of privileged points and the 
result of the application of this function (f) to these privileged points and by applying the 
function (f) to tag equations of the preceding image of the sequence to construct the tags of 
the predicted image. For example, a similarity transformation consisting of a rotation, a 
translation and a scale change, expressed in the complex plane as : 

30 f(z)= Az + c, A,ce V 

is used to constrain the motion. The module of A gives the scale factor, while its argument is 
the rotation angle, c is the translation vector. In this form, the optimization of X and c in the 
sense of the least squares criterion can be implemented by the pseudo-inverse method in 
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(€) using the privileged points. The predicted tags are then computed by applying the / 
(A>c) transformation to the former equation of tags of the preceding image. 
Once the predicted image has been constructed, it can be provided to a tag point detection 
step 15 (FIG. 1) in order to select tag points of a next image. 
5 FIG. 4 illustrates the main features of an example of an MRI apparatus 30 to 

carry out the method as shown in Fig. 2. The MRI apparatus includes an acquiring system 31 
to acquire data from a site of the body 32. Said data are applied to a processing system 33, 
generally included in the MRI apparatus 30 as illustrated in Fig. 4a. In a variant, this 
processing system 33 can be implemented in a computer 34, independent of the MRI 

10 apparatus 30, but connected to it, as illustrated in Fig. 4b. The processing system 33 executes 
a set of instructions according to a program. The program causes the processing system 33 to 
carry out the method of the invention on data provided by the acquiring system 3 1 . Said 
processing system 33 is connected to a display equipment 35 to display processed data. 

The drawings and their description hereinbefore illustrate rather than limit the 

1 5 invention, because there are numerous ways of implementing functions by means of items of 
hardware or software, or both. In this respect, the drawings are very diagrammatic, each 
representing only one possible embodiment of the invention. Thus, although a drawing shows 
different functions as different blocks, this by no means excludes that a single item of 
hardware or software carries out several functions. Nor does it exclude that a function is 

20 carried out by an assembly of items of hardware or software, or both. Any reference sign in a 
claim should not be construed as limiting the claim. The word "comprising" does not exclude 
the presence of other elements or steps than those listed in a claim. The word "a" or "an" 
preceding an element or step does not exclude the presence of a plurality of such elements or 
steps. 

25 



